Item order and speededness: implications for test fairness in higher educational high-stakes testing

نویسندگان

چکیده

A common approach to increase test security in higher educational high-stakes testing is the use of different forms with identical items but item orders. The effects such varied orders are relatively well studied, findings have generally been mixed. When multiple used, we argue that moderating role speededness on order cannot be neglected as missing responses commonly scored incorrect testing. If test-takers run out time while not giving answers easy at end test, they penalised stronger than if instead were unable provide difficult items. Using an illustrative real-data example a speeded show potential consequences ignoring can substantial respect fairness. Our proposed solution consists using fixed across from point which may become for some students. In this approach, most time-intensive placed test. simulation based real data two university examinations psychology students illustrates usefulness approach.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

High stakes testing in higher education and employment: appraising the evidence for validity and fairness.

The authors review criticisms commonly leveled against cognitively loaded tests used for employment and higher education admissions decisions, with a focus on large-scale databases and meta-analytic evidence. They conclude that (a) tests of developed abilities are generally valid for their intended uses in predicting a wide variety of aspects of short-term and long-term academic and job perform...

متن کامل

Interpreting the Validity of a High-Stakes Test in Light of the Argument-Based Framework: Implications for Test Improvement

The validity of large-scale assessments may be compromised, partly due to their content inappropriateness or construct underrepresentation. Few validity studies have focused on such assessments within an argument-based framework. This study analyzed the domain description and evaluation inference of the Ph.D. Entrance Exam of ELT (PEEE) sat by Ph.D. examinees (n = 999) in 2014 in Iran....

متن کامل

Differential Item Functioning (DIF) in Terms of Gender in the Reading Comprehension Subtest of a High-Stakes Test

Validation is an important enterprise especially when a test is a high stakes one. Demographic variables like gender and field of study can affect test results and interpretations. Differential Item Functioning (DIF) is a way to make sure that a test does not favor one group of test takers over the others. This study investigated DIF in terms of gender in the reading comprehension subtest (35 i...

متن کامل

High-Stakes Testing: The Background Behind Testing-Based Educational Reforms and Implications for Practice by Speech-Language Pathologists

47 1092-5171/03/3001-0047 ABSTRACT: Some current educational reforms (U.S. Department of Education, 2002) focus on preparing students for mandated testing. The Individuals with Disabilities Education Act (IDEA, 1997) requires education agencies to provide students with disabilities with the opportunity to participate in testing. Speech-language pathologists face the challenge of helping student...

متن کامل

High-Stakes Testing

I review the literature on the impact on student achievement of high-stakes testing. Its popularity as a mechanism for holding educators accountable has triggered studies to examine whether its promise to increase student learning has been fulfilled. The review concludes there is no consistent evidence to suggest high-stakes testing leads to increases in student learning. Some evidence suggests...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Assessment & Evaluation in Higher Education

سال: 2021

ISSN: ['0260-2938', '1469-297X']

DOI: https://doi.org/10.1080/02602938.2021.1991273